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- The MAILING DATE of this communication appears on the cover sheet with the correspondence address - 
Period for Reply 

A SHORTENED STATUTORY PERIOD FOR REPLY IS SET TO EXPIRE 3 MONTH(S) FROM 
THE MAILING DATE OF THIS COMMUNICATION. 

- Extensions of time may be available under the provisions of 37 CFR 1 .136(a). In no event, however, may a reply be timely filed 
after SIX (6) MONTHS from the mailing date of this communication. 

- If the period for reply specified above is less than thirty (30) days, a reply within the statutory minimum of thirty (30) days will be considered timely. 

- If NO period for reply is specified above, the maximum statutory period will apply and will expire SIX (6) MONTHS from the mailing date of this communication. 

- Failure to reply within the set or extended period for reply will, by statute, cause the application to become ABANDONED (35 U.S.C. § 133). 

- Any reply received by the Office later than three months after the mailing date of this communication, even if timely filed, may reduce any 
earned patent term adjustment. See 37 CFR 1.704(b). 

Status 

1)S Responsive to communication(s) filed on 24 August 2001 . 
2a)D This action is FINAL. 2b)^] This action is non-final. 

3) D Since this application is in condition for allowance except for formal matters, prosecution as to the merits is 

closed in accordance with the practice under Ex parte Quayle, 1935 CD. 11, 453 O.G. 213, 
Disposition of Claims 

4) ^ Claim(s) 1-38 is/are pending in the application. 

4a) Of the above claim(s) is/are withdrawn from consideration. 

5) D Claim(s) is/are allowed. 

6) M Claim(s) 1-38 is/are rejected. 

7) 0 Claim(s) is/are objected to. 

&*)□ Claim(s) are subject to restriction and/or election requirement. 

Application Papers 

9)D The specification is objected to by the Examiner. 

10) D The drawing(s) filed on is/are: a)D accepted or b)D objected to by the Examiner. 

Applicant may not request that any objection to the drawing(s) be held in abeyance. See 37 CFR 185(a). 

11) D The proposed drawing correction filed on is: a)D approved b)D disapproved by the Examiner. 

If approved, corrected drawings are required in reply to this Office action. 

12) D The oath or declaration is objected to by the Examiner. 
Priority under 35 U.S.C. §§119 and 120 

1 3) D Acknowledgment is made of a claim for foreign priority under 35 U.S.C. § 1 1 9(a)-(d) or (f). 

a)0 All b)D Some*c)Q None of: 

1 Certified copies of the priority documents have been received. 

2.D Certified copies of the priority documents have been received in Application No. . 



3.D Copies of the certified copies of the priority documents have been received in this National Stage 
application from the International Bureau (PCT Rule 17.2(a)). 
* See the attached detailed Office action for a list of the certified copies not received. 

14) D Acknowledgment is made of a claim for domestic priority under 35 U.S.C. § 1 19(e) (to a provisional application). 

a) □ The translation of the foreign language provisional application has been received. 

15) D Acknowledgment is made of a claim for domestic priority under 35 U.S.C. §§ 120 and/or 121 . 

Attachment(s) 



1) 12SI Notice of References Cited (PTO-892) 

2) CH Notice of Drattsperson's Patent Drawing Review (PTO-948) 

3) |3 Information Disclosure Statement(s) (PTO-1449) Paper No(s) 3 . 



4) Interview Summary (PTO-41 3) Paper No(s). 

5) □ Notice of Informal Patent Application (PTO-152) 

6) □ Other: 



U.S. Patent and Trademark Office 

PTO-326 (Rev. 04-01) 



Office Action Summary 



Part of Paper No. 2 





Application/Control Number: 09/935,610 
Art Unit: 2672 



Page 2 



DETAILED ACTION 



Drawings 



The formal drawings are approved. 



Claim Rejections - 35 USC § 103 



The following is a quotation of 35 U.S.C. 103(a) which forms the basis for all 
obviousness rejections set forth in this Office action: 

(a) A patent may not be obtained though the invention is not identically disclosed or described as set 
forth in section 102 of this title, if the differences between the subject matter sought to be patented and 
the prior art are such that the subject matter as a whole would have been obvious at the time the 
invention was made to a person having ordinary skill in the art to which said subject matter pertains. 
Patentability shall not be negatived by the manner in which the invention was made. 

Claim 1-38 are rejected under 35 U.S.C. 103(a) as being unpatentable over 
Hooper et al. (US patent no. 5,493,638) in view of Bonneau et al. (US patent 
6,002,794). 

Re claim 1, Hooper discloses a method of extracting overlays from video 
comprising the steps of detecting at least one potential overlay in a video sequence ( col. 
2, lines 22-67; col. 5, line 31 to col. 6, line 67 ). In other words, he teaches displaying an 
image by transmitting compressed video frames representing background and overlay 
portions. The background image is the creation of a compressed l-frame that 
independently describes the background image. For example, a button is added or 
overlaid on the background image. 

Hooper fails to discloses verifying that the at least one potential overlay is at least 
one actual overlay as claimed. However, Bonneau teaches verifying that the at least 
one potential overlay is at least one actual overlay ( col. 21, lines 19-28 ). In other words, 



ApplicatiorVControl Number: 09/935,610 Page 3 

Art Unit: 2672 

Bonneau teaches an image of an object is detected by the database based on the text 
overlay on the image itself. An object to be identified had been partially obscured, the 
matching technique would only be applied to the edge information associated with a 
portion of the particular objects stored in a database which correspond to the 
unobscured portion of the image to be matched. Thus, it would have been obvious for 
one of ordinary skill in the art to combine the step of verifying that the at least one 
potential overlay is at least one actual overlay of Bonneau to the system of Hooper 
because it would have improve the user interface of Hooper to allow precise 
manipulation of each pixel ( Bonneau: col. 21, lines 19-28 ). 

Re claims 2-3 and 16, Bonneau teaches post processing at least one actual 
overlay to remove extraneous pixel and computing a variance for each pixel of the at 
least one actual overlay; and comparing the variance with a threshold to determine 
whether or not the pixel should be removed as an extraneous pixel ( col. 6, line 18 to col. 
7, line 67 ). Bonneau teaches decomposing the image into first and second scale based 
on the pixel. He computes all the pixels with modulus that exceeds a certain threshold. 

Re claims 4, 25, Bonneau teaches detecting comprises the steps of performing 
wavelet decomposition on the video sequence ( col. 6, lines 46-67 ), extracting features 
based on the results of the wavelet decomposition ( col. 7, lines 50-67 ), and performing 
neural network processing on the extracted features ( col.11. lines 14-67: figs. 2 and 5 ). 

Re claims 5, 21, Bonneau discloses utilizing three-layer back-propagation neural 
network processing ( col. 12, lines 1-65 ). Bonneau discloses the different scaling of the 
wavelet transformation. The scaling shows the relationship between the range blocks in 
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high frequency scale one image to the domain blocks in high frequency first scale. The 
domain blocks for a given scale are mapped to the range blocks of the next lower scale. 

Re claims 6, 15, 30, 32-33, Bonneau discloses performing temporal verification 
and performing spatial verification ( fig. 1 -element 115 and fig. 6-element 525 V 

Re claims 7, 17-20, 22-24, 31, 34, and 36-38, Bonneau teaches translating 
potential overlay over a search range, for each translated version of potential overlay, 
computing a mean square error in a next video frame of video sequence subsequent to 
a video frame in which potential overlay is originally detected, determining a minimum of 
the computed mean square errors for next video frame, and comparing the determined 
minimum mean square error to a threshold ( col. 4, lines 51-67: col. 8, lines 36-63 ). 
Bonneau teaches the calculation between the first frame and the next frame. The 
average optical flow of the range and domain blocks is then calculated. If a large 
number of blocks are changed, the entire next frame will be encoded in order to 
minimize error in the image. 

Re claims 8-14, Bonneau discloses selecting a particular pixel of potential 
overlay and recording its coordinates and recording the translated coordinates of 
particular pixel corresponding to determined minimum mean square error ( col. 14, line 
52 to col. 15, line 46: col. 21, line 29 to col. 22, line 52: figs. 7 and 13 ). 

Re claim 26-28, Bonneau teaching is a in a computer software system. It is 
apparent that computer software is stored on readable medium. 
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Re claim 29, 31, and 35, the limitations of claim 29, 31 , and 35 are identical to 
claims 1-6. above. Therefore, claim 29, 31, and 35 are treated the same as discussed 
with respect to claims 1-6 above. 



The prior art made of record and not relied upon is considered pertinent to 
applicant's disclosure. 

Van Hook et al., US patent no. 6,166,748 
Marshall, US patent no. 5,675,746 
Knee et al., US Patent No. 5,589,892 



Any inquiry concerning this communication or earlier communications from the 
examiner should be directed to Thu-Thao Havan whose telephone number is (703) 308- 
7062. The examiner can normally be reached on Monday to Thursday from 9:00-5:00. 

If attempts to reach the examiner by telephone are unsuccessful, the examiner's 
supervisor, Michael Razavi can be reached on (703) 305-4713. 

Any response to this action should be mailed to: 

Commissioner of Patents and Trademarks 

Washington, D.C. 20231 

or faxed to: 

(703) 872-9314 (for Technology Center 2600 only) 

Hand-delivered responses should be brought to Crystal Park II, 2121 Crystal 
Drive, Arlington, VA, Sixth Floor (Receptionist). 



Conclusion 



Inquiries 



Application/Control Number: 09/935,610 



Page 6 



Art Unit: 2672 

Any inquiry of a general nature or relating to the status of this application or 
proceeding should be directed to the Technology Center 2600 Customer Service Office 
whose telephone number is (703) 306-0377. 

Thu-Thao Havan . — y 

Art Unit: 2672 / S 

July 25, 2003 - 
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SUPERVISORY PATENT EXAMINER 
TECHNOLOGY CENTER 2600 



